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Monte Carlo optimizations of Number Partitioning and of Diophantine approximations are micro- 
scopic realisations of 'Trap Model' dynamics. This offers a fresh look at the physics behind this 
model, and points at other situations in which it may apply. Our results strongly suggest that in 
any such realisation of the Trap Model, the response and correlation functions of smooth observables 
obey the fluctuation-dissipation theorem even in the aging regime. Our discussion for the Number 
Partitioning problem may be relevant for the class of optimization problems whose cost function 
does not scale linearly with the size, and are thus awkward from the statistical mechanic point of 
view. 



I. INTRODUCTION 

During the last half century different models have been 
proposed to capture the dynamical properties of glasses. 
Among the phenomenological approaches, an illuminat- 
ing and extensively studied minimal one is the 'Trap 
Model' proposed by Bouchaud [1]. It is based on the fol- 
lowing picture: a particle evolves in a landscape energy 
that resembles a golf course with holes whose depths h 
are exponentially distributed following ~ e~@ ah : 
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FIG. 1. Schematic view of the phase space 



At each microscopical time, the particle emerges from 
a hole to a horizon level with a probability ~ e~^ h . Once 
escaped, it immediately falls in a new hole, which is in 
many applications randomly chosen (i.e. Fig. 1 is in- 
finite dimensional). By construction, once the particle 
escapes from a hole, it totally loses memory and the sys- 
tem can be considered as reinitialized. The combination 
of exponential distribution of depths with an exponential 
probability of emerging yields trapping times following a 
distribution whose mean diverges if T < {5~ x . Glassy 



behavior results from the possibility of falling in holes 
with arbitrary long trapping times. We have the appar- 
ent paradox that if we consider any two times such that 
the system has just emerged from a trap, the dynamics 
is (statistically) reversible in time: irreversibility arises 
only because at the end of a fixed interval the system is 
most probably in a long-lived trap. 

These elements, existence of a horizon level up to which 
the system has to reemerge each time * , time reversibility, 
and the exponential density of states can be taken as 
the defining features of the model. Even if such particle 
behaviors have not been observed, this phenomenological 
approach gives many glassy features we can find in both 
structural and spin glasses. On the other hand, only 
recently trap model dynamics was shown to result for a 
microscopic model (the Random Energy Model) endowed 
with a microscopic stochastic dynamics [2] — somewhat 
surprisingly given that the original motivation for the 
model was the phase-space structure of mean-field glass 
models. 

Having microscopic realizations of the trap model is in- 
teresting, because it highlights physical situations when 
it may be relevant. There is a further reason: when it 
comes to studying the response of the dynamics to per- 
turbations, the trap model allows a wide range of pos- 
sibilities [3-5]: the reason for this is that, although it 
is quite clear how traps are affected by a perturbation, 
there is no unique prescription for how a perturbing field 
should affect the 'horizon', and through it the transi- 
tion probabilities. This is an important issue, since re- 
sponse functions (especially the Fluctuation-dissipation 



"The reader familiar with mean-field glass models will won- 
der if this coincides with the 'threshold' level arising there. In 
fact, it does not: dynamics just below the threshold does not 
involve either reinitialization or reemerging, except possibly 
at very late times 
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relation) have turned out to be amongst the most el- 
loquent observables of glasses [6] . 

In this paper we study two examples yielding trap 
model dynamics: the Number Partitioning Problem — 
itself a form of packing problem, and Diophantine Ap- 
proximations. The Number Partitioning Problem can be 
stated as follows: given N random numbers drawn from a 
uniform distribution [0, 1], divide them into two sets such 
that their sums are as close as possible. This is a cari- 
cature packing problem because if we consider N coins 
with independent random thicknesses , this corresponds 
to finding the minimal box height where they will fit in 
two piles. The Diophantine Approximations we shall con- 
sider is of the following kind: find integer numbers n and 
m such that n^/2 + m^/2> is as close as possible to an even 
integer. 

The paper is organised as follows: in section II we 
study the number partitioning problem from the dynam- 
ical point of view. In section III wc briefly describe how 
the problem of improving Diophantine approximations 
yields the same kind of dynamics. In the final section we 
use these results to discuss which features seem neces- 
sary for a model to have Trap Model-like dynamics, and 
we point out that when this happens, the fluctuation- 
dissipation theorem is obeyed, at least for smooth ob- 
servables. 



II. NUMBER PARTITIONING OPTIMIZATION 
AND THE TRAP MODEL 

From an optimization point of view, the unconstrained 
Number Partitioning Problem is the following: given a 
set of real numbers ai,<i2, ...,ajvj each one belonging to 
[0, 1], find a partition composed of two subsets such that 
the difference between the sum of numbers over the two 
subsets is as small as possible. It can be written as an 
infinite range Ising spin glass with Mattis-like antiferro- 
magnetic couplings Jij = —a^a^ 



H 



Mattis 



— E rn 



X 

SididjSj 



(1) 



or, alternatively 



N 

E 



(2) 



The ground state (for typical dj's) of (2) scales like 



(E mo ) oc VN2~ n [7]. This means that in the form (1) of 
the Hamiltonian, the system is such that the interesting 
behaviour occurs at exponentially small temperature in 
terms of the size of the system. In order to avoid this 
problem, in this paper we shall use a modified Hamil- 
tonian, whose ground state energy is extensive in the 



thermodynamic limit: 

E = T c \og{E m ) = T c \og 



N 



(3) 



T c is an energy scale and the ground state energy becomes 
T r In 2 N. 



A. Equilibrium analysis 

Non-extensive optimization problems, for which the 
optimum does not scale linearly with the system size, 
are not easily cast in the formalism of statistical me- 
chanics. For the number partitioning problem, Mertens 
[7] proposed a clever bypass: instead of working with a 
partition function defined on the basis of (1) or (2) and 
following the usual steps of computing the average free 
energy, he used statistical means to study directly the 
independence of energy levels. Thus, he argued that in 
the case of unconstrained number Partitioning problem, 
for large values of N energies E m are random variables 
distributed according to: 



P(E m ) 



V27R7 2 iV 



exp 



El 



: -\v) 



■&{E m ) (4) 



where Q(E m ) is the step-function and a 1 — (a 2 ), and 
that for E m < 0(y~N) they are independent. This result 
was later shown rigorously for the lowest k energies [8], 
and studied in great detail in all regions in [9]. 

From this it follows, applying the transformation E = 
T c log|i? m |, that energies E < O(logiV) are also inde- 
pendent random variables with a probability distribution 
given by: 



P{E) = K(N) exp f3 c E 



with KIN) = ; 2/ \ 
is shown in Fig. 2. 
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exp (2(3 C E) (5) 



For large N, the density of levels 
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FIG. 2. Entropy per spin s = vs energy per spin e = 
Inset: corresponding original NPP 



The thermodynamics of the Number Partitioning 
Problem written in terms of the new energy E with as- 
sumptions above can be obtained following Derrida's mi- 
crocanonical derivation for the Random Energy Model 
[10]. One first notices that there are two energy regions 

• If E > Ei n f = —NT c \og2, the density of levels is 
much larger than 1. 

• If E < E in f — —NT c \og2, the density of levels is 
much smaller than 1. 

For E < Ei n f the entropy vanishes, and for E > £";„/, 
the entropy reads, as N — > oo: 



S(E) 
N 



= log2 



N 



Q(-E) 



(0) 



Using the relation j§ = one finds that -j|=0 when 
T > T c , and that for T < T c , the energy sticks at E in f = 
— T c Alog2. Finally, the free energy reads: 



£ = V = - T dog2 
£ = -Tlog2 



if T<T C 



otherwise 



This is a first order transition [11], unlike the standard 
Random Energy Model transition, which is second order. 
Let us stress here that above an energy E sup — 0(logN) 
the density of states is again much smaller than 1. At 
this level , independence of energies is no longer expected 
[7]. In what follows, we shall be interested in transitions 
that involve low energy states so that these levels are not 
relevant. We shall not study any statistical property of 
levels picked at random, this is done in Refs. [7,8] and in 
all detail in [9]. We shall concentrate on the properties 
of energy levels as encountered by a specific dynamics, a 
related though clearly inequivalent question. 



B. Dynamical analysis 

The equilibrium calculation shows that the system 
maximises its entropy at temperatures greater than T c . 
In the low temperature phase T < T c , a Metropolis dy- 
namics of the system explores deep states in its attempt 
to lower the energy down to — In 2 N. We shall argue 
that single spin-flip dynamics naturally leads to a Trap 
Model, and perform numerical tests to substantiate this 
claim. The Metropolis dynamics is defined by transition 
rates verifying detailed balance: 



-j3{E r 
1 



if Ej > Ei 



otherwise 



(7) 



where {o~i} and {o~j} are configurations that differ by a 
single spin flip. Below T c already an N — 30 spin system 
cannot be equilibrated in reasonable computer time. 



1. Surface states and horizon 

As mentioned above, one of the defining features of the 
trap model is a horizon level to which the system has to 
return each time it escapes a trap. Let us show that a 
single- flip dynamics naturally leads to this. When 



E<E h = T c \og(a mm ) ~ -T c logN 



(8) 



with a m i n = min(ai, on) = 0(1/N), a single spin flip 
necessarily leads to a state whose energy is greater than 
Eh- In the present article, we call trap a state whose 
energy is lower than Eh and surface state, state whose 
energy is higher. It will turn out that for long times the 
system is dominated by long stays in deep traps, sepa- 
rated by rapid excursions close to the horizon level. 



Surface states 





Traps 



FIG 
states. 



Phase space 

3. Phase-space structure denning traps and surface 



A quick first check can be obtained by looking at the 
energy evolution. Fig. 4 shows a run for a N = 10000 
spins system at temperature T — 0.75 T c . It appears that 
the expected scaling invariance of traps is well verified. 
Also a necessary condition, the system looks statistically 
invariant with respect to time reversal (cfr. 4(a) and 
4(d)). Let us again stress this point: the trap model 
is time-reversible in an interval between any two exits: 
once a trap is left the system is as unoptimized as it was 
at the start, when the system is in a deep trap, it has 
no other choice but to entirely reorganize itself to get 
to a new deep trap. An amusing exercise is to reconcile 
reversibility with the systematic trend of energy decrease 
we see in Figure 5. 
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ro sets the timescale. Using the relation 




2.15e+10 4e+10 2e+10 

Energy vs. time for a single run. (a)Whole run. 
(b)Time magnification by 10 (c)Time magnification by 100(d) 
inverse time 



The existence of the horizon level is a direct conse- 
quence of the one-flip dynamics we have chosen, which 
forces deep traps to be many steps away from one an- 
other. Indeed, the very same system allowed to flip O(N) 
spins each step has an entirely different dynamics: the 
jumps tend to go to deeper levels at each step, and Fig- 
ures like 4 (a) and 4 (d) would look completely different. 



2. Time and energy distributions 

Let us first examine the transition rates in order to 
determine the trapping time distribution. In a first stage, 
we assume the system to be in a trap, that is E < E] x : 
the only way to escape is to reach a higher energy state. 
If we note x = Y^i=i a i s i> the probability to escape from 
a; by a single spin flip reads: 



P esc {E{ X )) = l.^ e -^(logk-2a iSi |-log|x|) 



If \x\ is much smaller than a min ( 



E^E h ): 



P, 



m = ^ E 



(9) 



(10) 



A N ee 



is the sum of N random variables 



with distributions with power-law tails p(X — a i T ) <~ 

X~ {1+ ^ for T < T c . This implies that for large N it 
becomes distributed according to a Levy law, and hence 
[12] A N ~ iVT and A^ 1 ~ N~^r. We thus have: 



t(E) = T e-P E 
t oc Ne 0Eh 



(11) 
(12) 



V>(t) = P{E)\ — \ 



(13) 



where P(E) satysfies (5), we recover a Levy trapping 
time distribution: 



iP(t) oc 



(14) 



If instead of assuming that one starts from a surface 
state, one computes the distributions of energies (or, 
equivalently, trapping times r) as encountered at given 
time t w , one obtains distributions modified by the obser- 
vation time. If we consider the probability of being at 
t w in a trap near the horizon, it is reasonable to assume 
that these are populated with a probability proportional 
to the Gibbs weight (with, of course, a cutoff at lower 
energies). We hence have: 



P E (E,t w ) oc e 



-(P-Pc)E 



(15) 



which implies, using the change of variables P T (r,t w ) 

' dE I 
dr 

T/T c -\ 



P E (E,t w )\m: 



P T (r,t w ) oc — 



t/t c 



r < t v 



(16) 



In the opposite limit of deep energies, one may assume 
that two very deep states are visited with the same prob- 
ability. One can prove this for the trap model, but here 
it remains a conjecture, just like all independence prop- 
erties. In any event, this would lead to: 



P E (E,t w )^N(t w )e^ E 



P (t t ) oc U{tw) 

^ Lw > ^ T l+T/T c 



T > t v 



(17) 



(18) 



demanding that J t °° P T (T,t w ) dr stays of order one, we 

have that TV <~ & Tc ■ More generally, considering that 
surface states have also Gibbsean weights, one can write 
a formula valid in all regimes [1,3]: 



P E (E,t w ) = e-^-M E r ^- 



-0E 



(19) 



where r(u) = 1 when u <C 1 and r(u) ~ u 1 when !t> 1. 
In particular, we have on average: 



(E(t)) ~-T c log - 



(20) 



where t is given by (12). In Fig. 5, we plotted different 
runs at different temperatures for a system of 10000 spins 
in order to show up the validity of (20). For different N 
similar curves are obtained. 
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k+04 lc+07 le+10 le+04 le+07 le+10 

FIG. 5. Time-dependence of energy E(t) for single runs 
at different temperatures- TV = 10000. Straight lines are ob- 
tained from (20) 3. Correlation between deep traps 



At a given time, we computed the distribution of 

traps by counting the number N T of visited traps whose 

length is r. Fig. 6 shows the rescaled density p s (r) — 
i 

(p(r)) 1+ * for a system of N = 1000 spins at = 10 4 
Monte Carlo steps, for different temperatures from T — 
0.7 T c to T = 0.95 T c . The curves are again in excellent 
agreement to what would have been obtained for the trap 
model. 




FIG. 6. Rescaled trap time distribution- N = 1000-t„ = 10 4 

In Fig. 7 we plot the energy of 50 spins obtained at 
t w = 2 10 4 for different runs, at three different tempera- 
tures. The straight lines correspond to the flat measure 
for the low-energy tails, and the Gibbs distribution for 
the high-energy tails. The agreement with the trap model 
behavior is excellent. 



The correlation between states of given energy in the 
number partitioning problem has been the object of de- 
tailed study following the proposal of Mertens [7-9] . Al- 
though these studies are no doubt relevant to the present 
work, one cannot transfer the results directly: while in a 
static study we consider the correlation of any two states 
below a certain energy, we are here forced to consider 
the correlation between states as visited by the dynam- 
ics. For example if we demand that two states are visited 
subsequently, given one state, we are considering a very 
specific subset for the next. In other words, dynamics 
may impose correlations on statistically independent en- 
ergy levels, and if independence emerges, it will be the 
result of a property of the dynamics. 

Another, as we shall see related question is the follow- 
ing: In the number partitioning model, the natural way 
to define the correlation between configurations, based 
on the spins is: 

1 N 

Csingle(twi t w + t) = — ^ ] S, (t w ) Sj (t w + t) (21) 
i=l 

On the other hand, the usual correlation studied in the 
trap model is defined as: 

r B t. . , f \ / 1 if Si(t + t w ) = Si(t w ) Vi 
^Single \?w,*w+i) - <^ Q otherwise 

(22) 

We shall later consider also the average correlation func- 
tions C(t w , t w +t) = (C S ingie{tw,t w +t)) and C B (t w ,t w + 
t) = (Cg ingle (t w ,t w +t)) ((•) denotes average over the 
noise history). Due to the characteristics of the trap 
model, it turns out that in the low temperature phase, 
and for large waiting times, the two correlations coincide. 
The reason is interesting in itself: at long times, the sys- 
tem spends most of the time in deep traps. Now even 
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though on average the passage between two deep traps 
takes for larger t w less and less proportion of the time, 
it still involves many spin flips. Figure 8 shows this for 
different single runs with N = 1000 at T = 0.75T C . As 
t w — ► oo, we see that the correlation Csingle{tw>tw + t) 
becomes essentially a single jump process: this is because 
the route separating two traps of typical life t w becomes 
long. 



C(t u ,t) 
1 - 



0.5 





t =5e4 




W 



t =le5 




2e+05 2e+05 4e+05 6e+05 8e+05 



0.5 



t =5e5 




2e+06 4e+06 

correlation functions 



2e+05 

FIG. 8. Single mi 
^E s i(* + t w )si(t w ) for N = 1000.T = 0.75T C . At longer 
times the bahvior approaches that of C B (t +t w ,t w ) 



Another way of confirming the increasing decorrelation 
during each passage over the horizon is to compute the 
first s fi rs t and second s secon d configurations to be visited 
under the condition that their energies are smaller than 
a given energy E*. Their overlap q = s first • s second /N 
is the smaller, the lower the E* considered, see Fig. 9. 



We have also computed the averaged autocorrelation 
and the response function for a single sample: 

1 N 

C(t w ,t w + t) = — 22( s i( t w)s i (t w +<)) (23) 



R(tw,t w + 1) = ^ 



d(Si(t)) 



^ dhi(t w ) J t 



, +t dt > 5 m (24) 



5h(t>) 



The response is numerically obtained by computing 
m(t) — -i? Yli=i £i s i(t) where {^} is a set of independent 
random variables that can take the values ±1. /i is an 
external field coupled to the spins via £j . The interaction 
term involved in Metropolis rates reads: 



JY 



E h = E + V h 



(25) 



At high temperature (T > T c ), the functions (23) and 
(24) become time translational invariant: there is no ag- 
ing and the fluctuation dissipation theorem holds (see 
Fig. 13). 

At lower temperature, (T < T c ), the system is aging. 
We computed the autocorrelation (23) for a N = 1000 
spins system at temperature T = 0.75 T c for different 
waiting times t w as a function of j-. The results are 
given in Fig. 10. Firstly, we see that the longer we wait 
the better the scaling becomes. We also see that the 
long-time behavior is well fitted by the analytical results 
of Bouchaud et al [3,17]: 



sin (tt£) 



du (1 - u) T c 1 u T <: 



but there is a long preasymptotic subaging regime. 



(26) 




FIG. 9. Overlap q between first and second configurations 
to be visited with E < E* . N = 1000. 




FIG. 10. Autocorrelation function-TV = 1000-T = 1.5 



G 



In Fig. 11, we plot the autocorrelation (23) of N = 
10000 spins at T = 0.9 T c for different waiting times t w 
as a function of (•£-)'• the preasymptotic regime is much 



longer: t su b ~ 10 7 and t s 
10 respectively. 



C(t,t 



10 b for Figs. 11 and Fig. 
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FIG. 11. Autocorrelation fonction-iV = 10000-T = 1.; 



Finally, in figure 12 we also show a response function. 



Z(t„, t) 




FIG. 12. Reponse function. 
t w = 5e6. h = 0.05 



N = 1000. T = 0.75T C 



In this section, we have shown evidence that in the 
limit t w — > oo, the present model becomes strictly the 
trap model: short-time discrepancies are due to the tran- 
sition states in the frontier between surface states and 
traps. Note however that near the critical temperature, 
critical corrections to the asymptotical scaling h(j-) are 
also expected in the original Trap Model [13]. 



4- Out of equilibrium fluctuation-dissipation relations 

One of the assumptions characterizing the trap model 
is the exponential distribution of energies. Given its close 
ties to the mean-field picture, and more importantly, to 
the 'entropy crisis' scenario of glasses, this is a feature one 
is reluctant to give up. On the contrary, when it comes to 
specifying how the transition times are affected by a per- 
turbation (such as a magnetic field) — or equivalently, 
how does a field affect the horizon level, there is consid- 
erable freedom. Indeed, given two states of energies E 
and E' with magnetizations M and M', respectively, the 
transition probabilities can be chosen as: 

P esc ({M, E} {M',E'}) = e -/ 3 M-(i-C)M'+ C M]p o( ^ ^ E r ) 

(27) 

where Pq{E — > E') is the rate without external field [3]. 
For any f, detailed balance is obeyed. One can thus show 
that the response becomes 



Of 



Cy + (1-C) 



dt„ 



dC(t w ,t) 
dt w 



(28) 



If C = the rate is affected by the arrival configuration 
(at first sight a bizarre choice), and the fluctuation dissi- 
pation formula holds. If C = 1, when the rate depends on 
the departure configuration, there is a complicated fluc- 
tuation dissipation relation that cannot be interpreted 
as resulting from an effective temperature (see [4,5] for a 
detailed discussion). 

The model studied here being 'microscopic', we have 
no freedom to choose how the magnetic field acts: the 
only reasonable choice is that the rates are given by the 
Metropolis prescription with an additional energy term 
Vh (25). Fig. 13 shows the fluctuation-dissipation char- 
acteristic at different temperatures above and below the 
critical temperature. Clearly, there is no FDT viola- 
tion t , 

As we shall see, one expects this result to be general 
for microscopic models when the observables are smooth 
functions of the spins. To understand this lack of viola- 
tion, first remark that it corresponds to the case £ = 0, 
as if the transition time did not depend on the original 
state. This is easy to understand: a smooth deformation 
of a golf course does not change the depths of the holes 
with respect to their edge: a single spin flip is enough to 
escape a hole but it does not change the magnetic energy! 



^This result has already been found in the one dimensional 
trap model [14], see [15] for an analytic proof. 
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FIG. 13. Fluctuation-dissipation relation for different tem- 
peratures above and below T c . For T = 1.5T C , TV = 10000, 
t w = le6. For T = 0.9T C , N = 10000, t w = 5e6. For 
T = 0.6T C , N = 1000, t w = 5e4. 

We have the following picture for state distribution: 
there are surface states and there are traps that are 
reached from those states. Deep traps are separated by 
many surface (and short-lived) states, as we confirmed 
in the previous section. If the system is perturbed since 
the beginning by a small magnetic field, there is a small 
reshuffling in energy, but surface states remain on the 
surface. 

Now, consider the time just before falling in a deep 
trap. The above consideration implies that the system is 
at the end of a tour consisting of many short-lived sur- 
face states. If we make the natural assumption that such 
states follow a Gibbs distribution even in the presence of 
a field, we conclude that the magnetization distribution 
just before falling is: 



P, 



before 



(M) 



JdeP sup (e,M)eP hM _ e@ hM G(M) 



Z h 



where P sup (e, M) is non zero only when e > Eh- 



(29) 
Zh is 

the normalization factor. After falling in the trap, we 
know that the energy has changed dramatically. How- 
ever, since the process of falling involves only one spin 
flip, the magnetization remains essentially unchanged (up 
to 0(\/N)). Hence, the magnetization distribution in- 
side the deep trap is also of the form 



P 



after 



(M) 



e r jhM G{M) 



(30) 



From this, the FDT result follows, since: 



(M 2 



(M) 
(M? 



= /3 



J dM Me l3hM G(M) 
Zn 

JdM M 2 ef 3hM G{M) 
Z~ h 

JdM Me^ hM G(M)Y 
Zh ) 

-id{M) 
dh 



(31) 



We stress here that this argument will hold for any ob- 
servable that, unlike the energy itself, is smooth in phase 
space (i.e., such that configurations that differ by a non- 
extensive number of spins have a negligible difference in 
the observable - in the opposite case, we describe them 
as rugged). 

The fluctuation dissipation relation in our model comes 
from a Gibbsean weight of states separating the traps. 
Numerical measurements confirm this scenario: 

1. We computed the energy of the last state visited by 
the system before falling into a trap. Fig. 14 shows 
the results both with and without an external field. 
We can see that there is the announced zero field 
horizon value for Eh = T c log(a m i„) under which 
the system cannot reach a trap by a single flip. 
Comparison with Fig. 7 confirms that when an ex- 
ternal field is added, the surface states essentially 
remain at the level of the zero-field surface, and 
are consequently still distributed following Gibb- 
sean weights. Furthermore, the deviation with re- 
spect to Eh vanishes faster than exponentially. 





' 1 












— h=0 








- h=0.02 




1 1 


1 1 



-10 



-9.5 



-8.5 



FIG. 14. Energy density of states preceding traps. TV = 50. 
T = 0.75T C 



2. A direct consequence of our derivation is the den- 
sity probability (30) for the magnetization. Fig. 
15 confirms the scaling P{M) cx e^ hM for different 
values of T and small h. 
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P (m) 



o T=0.65»T h=0.05 
□ T=0.75»T h=0.02 
, T=0.75«T. h=0.05 



m=M/N 

FIG. 15. Rescaled distribution P*(M) = e~^ hM P{M) for 
different values of h and T. Here, m = ^ is the magnetization 
per spin. N = 50 

From our analysis, the fluctuation-dissipation relation 
holds for smooth observables. The situation is different 
in the case of rugged observables. To verify this, we com- 
puted the fluctuation-dissipation relation in the case of 
an observable that resembles the magnetization but is 
restricted to be non zero only when the energy configu- 
ration is less than Eh = — T c log (a m i n ): 



M({ ai }) 



if E({ Si }) <E h 







otherwise 



(32) 



The fluctuation-dissipation plot is shown Fig. 16. The 
violation follows the relation: 



R(t w ,t) = -f3 



dC(t w ,t) 
dt 



(33) 



which corresponds to the case of £ = 1. 




FIG. 16. fluctuation-dissipation relation for observable 
(32). TV = 50. T = 1.5. t w = 5e4. h = 0.005 



This result is not surprising: On one hand, since M van- 
ishes in the surface states it does not affect the dynamics 
between traps and is insensitive to the depth of the ar- 
rival trap. On the other hand, the probability to escape 
from a trap with M is given by: 



P esc (M,£)oce^- feM ) 



(34) 



so that we have £ = 1. 

We are now able to give a physical picture of the 
fluctuation-dissipation relations for all £. Consider an 
observable A that is the combination of two observables 
A\ rugged (as (32)) and A 2 smooth: 



A = (Ai + (1 - ()A 2 



(35) 



and {A\{t w )) = (£«,)) — * 1- By definition A\ verifies 
(33) and the equilibrium fluctuation-dissipation relation 
holds for A 2 . Using linearity and the fact that for long 
times the autocorrelations of Ai and A 2 respectively be- 
come the same (a consequence of the dynamics of the trap 
model) one easily recovers the general case (28). Let us 
finally point out that the fluctuation-dissipation relation 
(28) is not restricted to values of ( between and 1. As an 
example, we report in Fig. 17 the fluctuation-dissipation 
relation for the parity: 



P({«i» = (-1)» IE ^" 1 



(36) 



It yields fluctuation-dissipation plots with (28) £ ~ 1.75. 




C(t w ,t) 

FIG. 17. FD relation in the case of Parity observable 



5. Nonexponential decay above T c 

Trap models exhibit interesting equilibrium dynamics 
in a range above T c . Let us see how this comes about 
in our microscopic model. Consider first the canonical 
partition function associated with (3): 



Z- 1° dE e^tagM/j-AOB 

lE inJ 



(37) 
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where Ei n f — —NT c log2. We make the change of vari- 
ables: 

-j3(E h -E) 



n(E) 



(38) 



n(E) represents the probability of escaping from a trap 
whose energy is E with the local dynamics (7). Then, Z 
can be rewritten as: 



z ^ e JVlog2-(/3-/3 c )E h 



dn n T <= 



(39) 



e -4,¥-JVlog2 

Since Eh is not extensive and is independent of T, the 
free energy in the thermodynamic limit can be written 
as: 



F = D — TN\og2 
D = -Tlog 



_^dn/(n)) 



f(n) = n^- 2 
Three cases must be considered: 



(40) 



• T > 2T C 

In this case J Q dn f(n) is finite and D has a non- 
extensive contribution to the free energy. 

• Tc < T < 2T C 

J dn f(n) is still finite and D has a non-extensive 
contribution, but f(n) has a singularity at n = 0: 



o.i - 



o.oi 



o.ooi 




:ooo 



4non 



FIG. 18. Correlation function above T c .iV = 1000 



6. Other 



distributions 



The Number Partitioning model can also be used as 
a microscopic basis for modified trap models. One may 
consider the definitions for the energy: 



E< = 



-(i+C) 



(41) 



for £ > 0, leading to non-extensive cost functions. 
Metropolis dynamics with this energy still goes in the 
right direction, but the dynamics is not trap-model 
like. In fact, repeating the arguments above one 
finds trapping times distributed according to P(t) cx 

T _1 [ln(r/r )]( 1+ ^. This case has also been discussed by 
Bouchaud [1]: at any temperature, one observes traps 
that become systematically longer in time. 



o 



• T < T c 

This time J e dn f(n) diverges when e — > 0, and 
hence D has an extensive contribution to the free 
energy. 

We see that below 2T C the equilibrium measure abnor- 
maly populates the dynamical states with low proba- 
bility of escape n(E) ~ 0. This is the origin of time- 
heterogeneites in dynamics and it naturally coincides 
with the divergence of trapping times' variance (14). As 
T is lowered, the effect of low n states in the dynam- 
ics becomes more and more pronounced [16-19], and the 
equilibration time finally diverges at T c , when the states 
with low n(E) become dominant. In Fig. 18 we compare 
the correlation function at T — |T C and at T = 2T C . Al- 
though there is no aging and the system equillibrates, the 
correlation function has a long tail in the former, that is 
absent in the latter case. 



III. DIOPHANTINE APPROXIMATIONS 

Number theory is a gold mine for glassy models with- 
out quenched randomness. This is because a program 
failing to find the good solution is trapped by the usu- 
ally enormous number of near misses which behave as 
quasi-random numbers. Consider the problem of Dio- 
phantine approximations: we are asked, for example, to 
find integers n and m so that ny/2 + is as close 

as possible to an even integer. We can express this by 
saying that we want to minimize an energy 

E = ln{F(nV2 + mV3+^)} (42) 

where F(x) is the separation between x and its nearest 
even integer. One can view this optimization problem as 
a diffusion of a particle in a bidimcnsional lattice (n, m) 
with a periodic potential (42) inconmensurable with the 
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lattice spacing (Fig. 19), so that the places with E = — oo 
are always missed. 



Incommensurable Potential 





FIG. 19. 2d-diffusion with irrational steps. The diagonal 
lines represent the integer values of n\[2 + my3 — even, 
where the energy is — oo. 



Let us give an alternative representation. Fig. 20 
shows the same problem, where we have now plotted one 
period of the potential, and assumed periodic boundary 
conditions. 



F(x)=log(x) 




FIG. 20. Id-diffusion with irrational steps. 

In this representation, each move is a large step, be- 
cause it goes around the boundary. What this second rep- 
resentation suggests is that a succession of many moves 
amounts to generating a (pseudo) random number in the 
interval (—1, 1): we can thus expect the equilibrium mea- 
sure to be flat and E = ln|x|. The energy density of 
states of energy E would then be exponential, since: 



P(E) 



d.v 



dE 



(43) 



Now, given a point (n, m) that yields a good approxi- 
mation to an even integer, moving to nearby points like 
(n+ 1, to) or (n, to + 1) will completely spoil the approx- 
imation, since it implies jumps of y/2— 1 or a/3 — 1. This 



is an horizon as in the previous section: it is necessary 
to reemerge in order to find a deeper place. *. 

We can now make the assumption that in the large, 
the diffusion process as viewed in Fig. 19 is a diffusion 
in a lattice with trapping times distributed according to 
a Levy law. From what we know from such problems, 
returns are relatively frequent in two dimensions, some- 
what changing the behavior [21]. In order to make the 
comparison simpler, we have thus simulated a three di- 
mensional problem E = In F(py/2 + + r^/b) . Figure 
21 shows the behaviour of energy which looks just like 
in a trap model, the Levy flight leading to a subdiffusion 
process [21]. We have performed most of the tests as in 
the previous section, but the results being numerically 
indistinguishable, we do not present them here. 




100 le+05 le+08 

_ t 

FIG. 21. Approximating integers as p^/2 + q\/?> + r\/5, with 
p, q, r integers (see text) 



In order to stress the relevance of the horizon in the 
dynamics, consider the potential ln|a;| with x G (—1,1), 
with Metropolis dynamics but with the configurations 
drawn each time at random in the interval (—1,1). One 
can easily check that the dynamics is entirely different 
from the trap model. The best way to convince oneself of 
this is to consider the limit T = 0: unlike the trap model, 
the system manages to decrease its energy monotonically 
without any activation, it suffices to wait long enough 
that the new configuration proposed has a sufficiently low 
new energy. On one hand, we have a Bouchaud dynamics 
for the irrational jumps and on the other hand, we have 
a diffusion that resembles more to the Barrat Mezard 
model (where there is only descent) [22] if all steps are 
allowed. In the case of very small irrational steps, we can 
expect a crossover between these two regimes [23]. 



'The situation is strongly reminiscent of the trapping in sub- 
recoil laser cooling, see [20] 
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IV. DISCUSSION 

1. Trap model behaviour 

In this paper we have given two instances in which trap 
model like behaviour arises at long times, and we have 
used them to draw conclusions on what are the features 
required from a microscopic model for this to happen. 
A first obvious condition is the existence of states with 
a large distribution of trapping times. This, however, is 
not enough. As mentioned several times in this paper, 
the trap model is such that once system emerges from 
a trap to a 'horizon' level, it is completely reinitialized. 
Furthermore, it is reversible in the sense that given a time 
interval delimited by two escapes, the history within it is 
equally probable than its time-reversed one. Irreversibil- 
ity only arises because the fraction of time the system 
spends near the horizon becomes progressively smaller, 
although it never vanishes. 

The question one may ask is under what circumstances 
can one have a horizon level with such a property. Con- 
sidering the Number Partitioning problem as the prob- 
lem of minimising the height of a box needed to pack 
two piles of coins of random thicknesses, we have seen 
that the horizon level arises when the system has been 
optimized up to the thickness of the thinnest coin: af- 
ter that, any swap of coins will necessarily bring back 
the system to the horizon, and improvements only result 
after global rearrangements. One has then a crossover 
between irreversible early dynamics, where single swaps 
may be advantageous, to a trap/reinitialization dynam- 
ics at longer times. One may conjecture that this might 
be quite general of packing problems. 



Initial conditions Nice packing 




FIG. 22. Direct compaction (left) at the first stages, global 
rearrangements as in the trap behaviour at late stages (right). 



Glass systems and granular matter have no doubt a 
first regime of irreversible compaction, during which a 
trap (whenever we are able to define one) is most proba- 
bly followed by a deeper trap, and this is also the case of 
the dynamics of schematic models. Thus, one can envi- 
sion true Trap Model behaviour arising at extremely long 
times, when each improvement requires complete reshuf- 
fling: this will surely happen at the level of optimization 



of a few grains (Fig. 22), in agreement with the analy- 
sis for the Random Energy Model [2]. Another, perhaps 
more relevant situation could arise at shorter times, but 
considering the trap behaviour of subsystems separately. 

2. Fluctuation- dissipation relation 

One of the main conclusions of the analytic solutions 
of glassy dynamics [6] is the central role played by the 
fluctuation-dissipation relations. It has hence become 
standard practice to study numerical and experimental 
systems from this point of view, and quite naturally one 
is led to look at this question in the Trap Model. As we 
have mentioned above, the model as it stands allows for 
great freedom in this respect: since we are free to spec- 
ify how the fields modify the barriers, the response to a 
field can strongly depend on this prescription. One of 
the main points of this paper is that for observables that 
are smooth functions of the microscopic variables, the 
fluctuation-dissipation relation holds in the aging phase 
just as in equilibrium. Although we have shown this 
for the two specific models, the argument seems robust 
enough: the energy being rugged, escaping a deep trap 
involves a few steps, a distance along which a smooth 
variable does not vary. Only long trajectories feel spa- 
tially smooth perturbations, and these happen near the 
horizon level which can be assumed to be in local equi- 
librium. Let us note here that smooth variables cannot 
be correlated with the energy, which is itself rugged, so 
they are 'neutral' in the sense of Sollich [4]: they are not 
'what is being compactified'. 

Once again we find confirmation that trap model be- 
haviour can only arise at very long times: for example in 
mean-field models even within the activated regime one 
has initially a violation of the equilibrium fluctuation- 
dissipation relation [24] , and the emergence of an effective 
temperature. This means that if these models eventually 
cross over to trap model behaviour, this will be only after 
the effective temperature has thermalised with the bath 
temperature, and this is expected to happen when ener- 
gies are barely (to 0{N)) above the equilibrium energy. 
It would be interesting to understand this crossover bet- 
ter, as it may be relevant for finite-dimensional models. 

3. Optimization and Non-extensivity. 

The Number Partitioning problem is nonextensive if 
one defines the energy as the absolute value of the differ- 
ence, in the sense that the ground state energy scales 
as an exponential of the size, or equivalently, that in 
a thermodynamic construction the interesting tempera- 
tures are exponentially close to zero. Working with tem- 
peratures that depend on the size is always awkward, 
so we have chosen a new energy as the logarithm of the 
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old one. This immediately led to a well denned thermo- 
dynamics and, via Metropolis dynamics, to trap model 
behaviour. 

Because the trap model is by construction forgetful of 
its history, its appearence in an optimization algorithm 
is a sign that things are as bad as possible. Indeed, our 
scaling forms for the dynamics immediately yield expo- 
nential times to reach the ground state - essentially what 
one would have obtained by blind enumeration. An inter- 
esting property one can check is that, not surprisingly the 
best temperature from the point of view of optimization 
is the critical temperature. 
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